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INTRODUCTION 



This' -study was designed to achieve two primary goals- The first goal 
was to evaluate the Longr-term sustained impact fcf the Chapter I Compensatory 



Education Program operated by the Schoql District of the City of Saginaw 
on both former participating pupils and^pupils who 'continued to participate 
because of low achievement . A second goal was to meet an evaluation require- 
ment of Chapter I* of the Education Consolidation and Improvement Act (ECIA) 
of 1981 which required that once every three years, since the 1978-79, school 
year a determination be made, whether improved performance is sustained over 
* a oerio' of more than one year from programs funded un*der this act. 1 * > 
; The Saginaw program funded under Chapter I is entitled Supplemental 
Teacher Participatifcn (STP), The purpose of this program is to improve the 
reading and mathematics achievement of a designated number of educationally 

disadvantaged- students'. The Chapter I funded STP program served approxi- 

2 

mat6ly 2,000!- students in grades K-7 each of the three years since 1979. 

Both product and process evaluations of the program have been conducted 
forltshe past three years. The product evaluation reports describe the aca- 
demic achievement 'of STP students fully and are available upon request from 
the Department Of Evaluation, Testing and 0 Rescarch. Grade level achievement 
of the performance standard in both subject areas are summarized in the 
chart* below for She three school years of interest. 



The funding legislation was originally known .as Title I of the Elemen- 
tary and Secondary Education Act of 1965- . — ~- 

Eighth grade students were also served during^ t he 1 98 1 -8.2^&chojoJL -#ea r~ 



' Overall Record of STP Program Attainment from 1-979. to 1982 

Attainment of Performance Standard* 



Grade 


Sub iect 
j j - 


1979-80 


1980-81 




1981-82 ' 




Reading 


Vac 


No 


* 


Yes 


Ok 


Mathematics 


Yes" 


No 




Yes 


L 


Rca>d i ng 


Vac* 
12 5 






Yes' 




Mathematics , 


, Yes 


Yes 




Yes 


2 


Reading 


xes 


Vac 








Mathematics 


Yes 


Yes 




Yes 


o 


Reading 


! • 

^ - xes 


ViU 




No 




Mathematics 


- '* ' Yes 


No 




No 




Read v ing 


xes * 


Vpe 
o Leo 




Yes 




Mathematics 


Yes 


Yes 




Yes 


5 


Read) ng 


Yes 


f NO 




Vpc ' 
lea 


*+ 


Mathematics 

♦ * 


Yes 


Yes 




Yes 


6 


Reading 


Yes 


Yes 




Yes 




Mathematics •*» 


Yes 


Yes 




Yes 


7 x 


Reading 


^ Yes 


No 




No 




Mathematics 


Yes 


No 




No 


8 


Reading 








' Yes 




Mathematics 


r 






Yes 


Summary of Performance 


16-Yes (100.07.) 


9~Yes (56. 


27.) 


14-Yes (77.87.) 


Standard Attainment 


0-No ( 0.07.) 


7-No (43. 


87.) 


4 7 No (22.27.) 



Overall, the achievement . levels in the attainment of the performance 

' 2 

standard for the STfe program have been very positive. Achievement of the per 
fo.rmatice standard was the best during 1979-80 with 100% pVsn.tive attainment • 
followed by 1981-82, with 77.87, positive attainment, and I980-81 o with 56,2% 
positive attainment. Student achievement levels for reading arid mathematics 
fjeemed quite similar in terms of attaining the performance standard over thfe 
three year period. 



1 Attainment o£ performance standard is defined a\s an improvement of the 
mean post-te's-t percentile score over mean pre-test percentile score. 

2 Mullin and Summers (1983) have just completed a study of. all the "major" 
compensatory education studies .^Generally J^ejj-^yiew_^djxate^ 
oelisac^rT^au^ioirTrograms have a positive though'^mal'l effect on the- 

v , _ _ j _ » i - f in/K' nr»p 1 1 1 u chr»tjf>H much 



achievement of disadvantaged students. Our findings locally .showed much 
largqr positive gains (at or above "normal growth") across the majority of 
grade levels. . . 

2 „ 



, It is in this context that the Department oE Evaluation, Testing, and 
Research has attempted to implement an investigation -into "the sustained 
effectiveness o£ its Chapter I STP program on participants who obtained dif 
forential lengths of service from the STP program: , 



' STUDY DESIGN ' 

The third graders in the Chapter I .STP program during the 1979-80 pro- 
/gram were chosen as the subjects for the study. The choice was made 'for the 
following reasons: 1) test data on tlie majority of students would exist *at 
the end of the three year period because district-wide testing occurs both in 
'the spring of third and fifth grades* 2) third grade is typically -where 
accumulative academic deficits seem to become more pronotmced, and 3) ari 
adequate number of participants at this grade level seemed to exist to allow 
for meaningful comparisons of participation with varying lengths of STP set- 
vice. The decision to save^ltfta for this longitudinal study was mad^ during 
the 1979-80 school year but the grade level selected and the efcact nature of 
the study was not finalized untU/ the Fall of 1982. , ^ 

The problem addressed -,y t>he study was to determine if the Chapter *I 
STP program made a long-term sustained impact in terms of reading and mathe- 
matics achievement as measured by the California Achievement Tests (CAT). 

i 11 '■ ■ 

\ 

Two different standards were used*as criterion to determine the presence or 

# 

absence of a long-term sustained effect. The first criterion was "normal 
growth" (EchtePnacht, 1980). Normal growth is defined as an estimate of 
how well students will perform in the absence of any special program. The 
use of the concept of "normal growth" requires, in this context, a pro-test i 
measure of all district third grade students. Spring, 1980 CAT results 
served as the pre-test and Spring, 1982 CAT test results served as the post- 
test when the concept of "normal growth" was employed to determine the per- 
cent of gain beyond "normal growth". This additional growth in c.ompaijjson_ 



to "normal growth" ib one standard chosen as a measure of sustained effect. 
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The second criterion .chosen was a normal curve equivalent (NGE) score 

k m « 

gain equal to o$ greater than the gain of third. grade pupils who were in the^ 
STP program from the Fall, ,1979 tfirough 'Spring, * 1982 as fifth graders-. 
Participants in the; STP program had to have pre-test scores at, or below the 
44 NCE to rema ineligible for each of the three years. The thVee year 

STP participants were pre-tested (Fall, 1979) and finally post-tested (Spring, 
0* ' 

1982) on CAT. * The average gain-, of this group of continuing ST|> participants 
served as the second criterion against which the results for the other groups 
were compared. , . 

The results of four different levels of STP participation were under 

* ***** 

study from the original group of 1979-80 tkrd grade STP participaats who 
were pre- and post-tested during that school year (N = 335). The four pos- 
sible levels of participation and additional CAT testing points are described 
be low r 

Categories of Participation 



Category Q —During the two year 'period from Springy 
1980 to Spring, ,1982 these pupils ho longer partici- 

• patcd in the STP program but w«*re tested in the Spring, 
1982 (district-w^de fifth grade testing). 

• Category 1^ -During the one year period from Spring, 
1980 to Spring, 1981 these pupils continued to partici- 

■ pate in the STP program (tested Spring, 1981) and from 
. Spring, 1981 to Spring, 1982 these pupils no longer 

participated in the STP program but were tested in 
, the Spring, 1982 (district-wide fifth grade, testing) . 

♦ Category 2 — During the two year period from Spring, 
1980 to Spring,* 1982 these pupils participated in the 
STP program and were tested the Springs of 1981 and 
1982. 



Cate gory 3 — During the one year period fr om Spr ingy 
T9#Tto S^£ng7TWl these pupils no longer partici- 



pated in the STP program (tested Spring, 1981 as poten- 
t ial STP participants) and Erom Spring, 1981 to Spring, \ 
1982 these pupils we/c readmitted because of low 
scores for participation in the STP program and were 
«teste$ again in Spring, 1982. 



erJc * - 10 



These four levels of participation are fundamental to Che statement 
of the study hypotheses. The study hypotheses stated below are grouped 
according to the criterion, categories discussed earlier* 

* Hyporh vsoas Normal Growt-h 

— i — — ^ 

1. There will be growth equal to or efccqeding !t normal 
growth 11 in reading any mathematics "as measured by 
CAT for the category 0 pupils (one year STP parti- ^ 
cipation) A x 
/ 

. 2. There will be growth equal to or exceeding "normal 
growth 11 in reading and mathematics as measured by 
CAT for .the category 1 pupils (two years continuous 
STP participation). 

3. There will •fce growth equal to or exceeding "normal 
growth" in reading'and mathematics as measured by 
CAT for the category 2 pupils (three years continu- 
ous STP participation). 

5. There will'te growth equal to or exceeding "normal 
' growth 11 in reading and mathematics as measured by , 
CAT fov the category 3 pupils (two yaax interrupted 
STP participation) ; 



Hypotheses: KCg Gains 

1. There will be growthflcqual to, or exceeding category 1 
students in reading and mathematics as measured by 
CAT for the category 0 pupils (one year STP parti- 
cipants). t * * '* 

2. There will be growth equal to or exceeding category 
students in reading and mathematics as measured by 
CAT for the category 1 pupils (two year continuous 
STP participation). f j 

3. There will be growth equal to or exceeding categpry 
students in reading and mathematics as measured by 
CAT for/the category 3 pupils (two year interrupted 
STP participation)* 



^ach instance where a length of participation is stated it .is meant that 
the pupil had at. least that number of school years of participation from Fall 
1979 to Spring 1982. They possibly could have had additional years of partici- ^ 
pation prior to Fail 1979. For the interest of convenience, yeai»s of possible 
participation for the '•scope of this study will range fjrom one to three. Recom- 
mendations to enlarge the longitudinal nature of future studies are girven at the 
end of this study. x 
O' . . - 6 

ERIC 11 x 



PRESENTATION OF DATA > 

Wh^t fol'HJws 'presentation of the data contrasting the four category 

groups according to two* growth.' standards . "The first criterion used to coi^ 

trast growth lcveU is "normal growth 11 . The other criterion employed is UG£ 

» • * 

gains o£ the, three year continuous STP group (category 2). 



•'Normal Growth 11 Criterion Results 



i 



Table 1 below compares Chapter 1^ results in reading and math with normal 
growth by category. The term "normal \^owth" is an index which standardizes 
the scores for an entire grade level, thereby allowing comparisons with any. 
'subgroup ol interest. These data incorporate a time span o£ Spring, 1980 to 
Spring, 1982. , 



TABLE f. COMPARISON OF CATEGORY GROUP GROWTH TO NORMAL GROWTH. 



* 


V 

• 0 . 

oj-st) 


1 ' 
(N=21) 


Category 
2 

- .(N=139) 


3 

(N=15) 


District 
CN=1,222) 


Reacting 
Normal Growth 


2 5. S 


25.8 


1 

25.8 


25.8 . 


25.8 


Category Group 
Growth 


29.8 


30.8* 


31.8 


27.8 J 


31.8 


% Additional 
Growth 


, 15.5 


19. A 


23.3 


. 7.8 


.23.3 


Mgth ' r 
Normal Growth . 


37,3 . 


37.3' 


37.3 


37.3 


' ■ 37.3 


Category Group 
Growth 


38.3 


40.3 


Al.v3 


33.3 


43.3 


7» Additional 
>Growth j 


.2.7 


, 8.0 


10.7 


-10.7 


16.1 
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As indicated in Table 1, nopal growth for third grade reading attained 

a value of 25.8 NCE's. Using this number as our baseline, category 0 (those 

'.•students having had the least amount of compensatory education instruction) 

showed a growth of 29-.S NCE, or 15.57, better than normal growth. Category 1 

(those students with approximately two years of continuous compensatory educa- 

tion instruction) had a growth of 30.. 8 NCE or 19.4% better than normal growth. 

' \ I. i \ 

Category 2 (those students' who have .receives compensatory education instruc- ^ 

* " ° \ * \ 

tion during the^ entire three year span) -achieved a growth of 3*.8\NCE or 23.3.% 

better than normal growth. Category 3, (those students who had approximately 
two years of Interrupted compensatory educatibn instruction) showed- a growth 

g . V^. ■» - ' N ' 

of 27.8 NCE or 7.87o betterThan nprmal-gr^th^--T-he-d-i^ricL=wl^.e_growth result 

for this same time period was 31.8 NCE or 23.3% better than normal growth. 

Table 1 also presents the same information by category - f or mathematics . 

Again, normal growth is the standard for compa^son. Normal growth had a 

value of 37.3 NCE over this three year- span! Category 0 achieved, a growth of 

1 

• 38.3 NCE or' 2.77. greater than normal growth. Category 1 showed a growth of 

& " m . 

40.3 NCE or 8.0%dj*sater t.han normal-growth. Category 2 showed a growth value* 

of 41.3 NCE or 10. 7%' greater than the baseline value of 37.3 NCE. Catego/ry 3 

had a growth value of 33^3 NCE or 10.77. less than normal growth. The-dis- 

crict-wide growth value was 43.3 NCE orM 6.. 17. greater , than normal growth.' • ■ 

A review of the preceding information lays the foundation for the belief 

V that academic achievement Saginaw's compensatory education population is 

positively associated with the amount of continuous time spent in the Chapter t 

STg program .. For- categories 0, 1 and 2 where instruction was provided for 

"M>ne, two' or three years without a break, v the growth was equal to or greater ^ 

. than that of normal growth in both reading and mathematics. Only in 



category 3 where compensatory education services were not continuous did the 

» 

pattern waver, with reading exceeding normal growth and mathematics falling 

short .of * the standard* 

The following chart designates which category group(s) grew at a rat-e 
e,qu-al to or exceeding that x>f normal growth for reading and mathematics. The 
chart also relates these questions back t'o the hypotheses stated earlier 
concerning the normal growth standard. . 

* i 

Results Which Equal or Exceed 

Normal Growth r> , 

Category Relates to ' 

Group R eading * Math Hypothesis : 

0 Yes Yes . 1 

1 Yes Yes 2 



2 Yes 7es^ — — 3~ 

3 Yes No 4 



As the fchart indicates,' all categories were able to equal or exceed 
normal growth in reading and all but one category in mathematics achieved 
this goal.* Now, the gains of category groups 0, 1, and 3 are contrasted 
with the NCE gafin criterion of category 2 (the three year continuous STP 
group). „ 

• / • " 

NCE Gain C riterion % 

As *NCE gains are used by the state and federal government as the pri- 
mary way to report annual Chapter I results, it would seem that such a 
measurement of academic growth is also viable for this study. Tables 2 and 
3 below present another way to denote achievement-gains by the compensatory 

education groups, using NCE gains by category for different time periods 

* » 

for both reading and mathematics . : Tab Le 2 below presents the reading gains 
over the three* year period of study as well as at periodic bench marks. 



TABLE 2. ~GAltf (IN NCE} OF CONTINUING COMPENSATORY 'EDUCATION 
GROUP BY CATEGORY — READING . 



Time Span 


o 


Category 
1 2 


3 


FaU, 1979 lo Spring, 1980 


5 


5 


- 6 


6 


Spring, 1980 -to Spring, 1981 




4 


2 ' 


°-5 


Spring, 1981 to Spring, 1982 


♦ 


1 


4 


7 


Spring, 1980 to Spring, 1982 


4 








Total Net'Gain 


, 9 


10 


12 


8 



Category 0 showed a gain of 5 NCE ! s over the 1979-80 school -year while 

i ♦ 

participating in the Chapter I program* .After leaving the program they were 

not tested again until Spring, 1982 as fifth graders where they showed a 

1 * ' ' . 

gain of 4 NCE's* Therefore, over the three year per i^d~a~-trotrarl-net^ga i-n-af- 

9 NCE wa,s made. Category 1, participants in Chapter I for two consecutive 

years, had gains of 5 NCE the first year and> NCE the second. As fifth * 

graders, they did not participate in compensatory education but were tested 

in the Spring, 1982 as part of whole grade testing. The gain at that time 

was 1 NCE, thereby giving a total net gain of 10 NCE. fategory 2, having 

been in- the Chapter 1 program for three CQnsecutive years, yielded gaiiis of 

6, 2 and 4 NCE for each of the testing points. Overall, category 2 showed a 

total net gain of. 12 NCE* Category 3, those whose participation had been <* 

two non-continuous years, showed an initial gain of 6 NCE for the first year 

in the program. The next testing (Spring, 1980 to Spring, 1981) shpwed a 

loss o£, 5 NCE< f or these same* students. The reader should ^remember, that this 

group did not receive STP Chapter 1 help during the 1980-81 school year but 

wete' tested in the* Spiring of 1981 as potential compensatory education 



students for the next school year. The 1981-82 school year found them back 
in the Chapter 1 program and their spring test scores for that school ye'Br 
indicated a gain of 7 NCE. Overall, this group showed a total net gain of 

— * 

8 NCEi ' • . , 

V 

The mathematics results are presented in Table 3 below- The totaL net 

gain in NC£'s of category/ group 2 again served as the criterion. 

/* 

TABLE 3. GAIN (It-LNCE) OF CONTINUING COMPENSATORY EDUCATION 
GROUP BY CATEGORY — MATHEMATICS . 



Category 

, Time Span Q ^ ■ 2 3 

Fall, 1979, to Spring, ,1980 H 15 9 , 10 
Spring, 1980 to Spring, 1981 — 0 0-8 

-Spri-ng-r-l4)Al-^_Spxing.'^l982 — 3 A 4 

Spring, 1980 to Spring, 1982 i 



Total Net Gain 12 18 ,13 



Category 0 showed a gain of 11 NCE's over the 1979^80 school year during 
which they participated in Chapter I. Although no longer participating in 

▼ it 

compensatory education after 1979-80; the students showed a gain of 1 NCE/ 
from the Spring, 1982 whole grade testing, .giving a total net gain of 12 NCE 
for this giroup. Category 1 showed a gain of 15 NCE during the first year of 
compensatory education participation but no gain the second yeac. As part . 
l0 f whole grade testing in'Spring, 1982, this group (no longer Chapter 1 par- 
ticipants) showed a gain of 3 NCE. Category 1 had a total net gain of 18 
tiCE over the three year period. Category 2, those who continued in Chapter I 
for the entire throe years, had a gain of 9 NCE the first year, no gain the 



\ 



second year, and a gain of 4 NCE the third year, for a total net gain of 
'43 NCE over the three year period. Category 3 had a gain of 10 NCE the 

first year of the program, a loss of 8 NCE during the non-participation 

< 

year of 1980-81, and a gain of 4 NCE for'the "next Chapter I segment during' 
the 1981-82 school -year. Overall category 3 had a total net gain of 6 
NCE. * 

The following Chart summarizes which category group(s) grew at a, rate 
equ^l to or exceeding group 2 (those students who have received compensatory 
education instruction during ^the entire three year span) for reading and 
mathematics. The chart also relates these questions bask to the hypotheses 
stated earlier. 

* t Results Which. Equal or Exceed Gains o 

~ Category "rf-tSrcegory Group 2 ; Relates to 

« Group Reading tfath Hypothesis t 

0 • No No 1 fl 

1 ' , No Yes 2 ' 
3 No No 3 



As indicated above, only category group \ participants in mathematics 
were able to equal or exceed gai,ns of category group 2 participants and none 
..of the three groups achieved this goal in reading. In an attempt to bring 
all the information together and bring closure, a discussion section follows. 



0 
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DISCUSSION • . 

The data 'presented on the preceding pages provided two standards used for 
comparison of the sustained effects of Chapter I participation. What follows 
is art attempt tro analyze sone of the data presented earlier. 

Chapter I students have demonstrated an academic deficit in reading and/or 
mathematics." Participation in the program is provided to students who score at 
or below the 44 NCE on CAT. Since standardized testing provides the district 
with a means to identify potential students, the use of test resultk should be 
considered as a source of information to document long-term effectiveness. As 
eligibility is reassessed each year, those who remain eligible continue to 
exhibit the greatest need. Consequently, category 2 participants (those stu- 
dents who remain in Chapter I programs> do show a .constant flower level o^ 

>- *± — : ; ^ 

v absolute achievement in comparison to other categories. The expectation might 
* » ' 

then be,, that these students would also show smaller increments of growth. 

However, it can be- seen (see Table 1) that Chapter 1 participants show the 

1 ^ " * ' 

greatest percentage of growth in comparison to the other STP groups studied - 0 

the longer they remain in the program without interruption. The data in 

Table 1 indicate any presumption Ghat academically disadvantaged children 

placed in compensatory\educa,L ion programs grow at lower rabes than normal may « 

be erroneous. Succinctly stated, our present expectation is thaj: Chapter I 

participants experience greater gains the longer they continuously participate 

in the STP program. , ' . * 



1 The authors acknowledge tfcat a small amount of net gain (0.5 NCE or less) 
reported by the various groups may be due to the regression effect (Roberts; 
1980, pp. 78-80). However,, the magnitude of the error is relatively small so 
that resultant gains still reflect a positive* effect of STP program participa- 
tion. Linn (1980) and Burton (1980) address the regression effect topic in- 
greater detail. for the interested reader. 

13 "18 ■ . 



This new expectation could lead to another related hypothesis concerning 
the^growth of^participants who experienced interrupted programming (category 3), 
This hypothesis, would hold that the gains of category 3 participants .would be 
the smallest o£ any of the- groups. Category 3 participants had the smallest 
percentage of additional growth in re.adiog and exhibited a loss in terms of 
growth in mathematics. A review of Tables 2 and § ^veajs that students whose 

Chapter I eligibility and service is interrupted show a loss of 4^NCE in^rfead- 

♦ t j " 

ing and .8 NCE in mathematics during the non-participatory year. No other 

« _____ - - 

•category demonstrated this phenomenon at any "other testing point. Two possi- 
ble explanations for this are: 1) students failed to consolidate learnings 
into their long-term memory and these short-term learnings were lost (failures 
to internalize learnings) or, 2) students obtained high scores not solely 
-becau ger-o-F-whatr-trhey— le ar ned t h beca use of tes ti n g abnu i ura LiftrL-G'S~rh^r^(^^"ed~ 



their scores to be systematically irf error in«a positive direction, i.e., 

false positives. Additional testing a year later along with teacher observa- 

<» 

* tions of lower performance substantiated that these students could not display 
their higher levels of achievement due to either inability to internalize 
learnings or lack of other testing abnormalities to again raise scores. 

It was observed ''that initial NCE gains (Fall, 1979-Spririg, 1980) were 
greater than the gains experienced over the next two years. An examination 
Q of Tables 2- and 3 reveal that subsequent NCE gains in reading and mathematics 
for categories 0, 1 and 2 following °the initial year (1979-80) of Chapter I 
participation never exceeded the initial gains. Poi.sible explanations for 



1 The reader should also note that only 15 of the 256 students (5.8%) in 
the study were in the interrupted participation category. This may have been 
too small a number to support a solid finding. ^ 

14 " ' 
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this occurence may be one or a combination of the following: 1) compensatory 

» 

educatipn gains are typically greater on a fall-to r spring rather than on a 

spring-to-spring testing cycle because of the possibility that, a) studentV-experi 
* * 

ence an "achievement loss' 1 and that skills are "forgotten 11 during the summer 

and/or x b) national norms assume that some growth will occur over the summer but 

compensatory education students 1 performance remains constant over this same 

* 

.period, thereby resulting in a gap between compensatory education students and 

v - 
the. national ^norms, (-Hill, 1979); 2) some of f-level testing of one or two 

■ ; ■ ' . . % - - * ■ 

levels below grade level did take place during Tall, which may have caused 

" deviations in scores from those that might have~been obtained from on r level 
•test ing;^axrtki) selection for participation was done on the basis of test 
scores and teacher judgmeat^ with teacher j udgment holding more weight initially 
than in the subsequent years owing^-Ea^tJihe 1979-80 school year was the 
first year of, introduction of CAT after many years^o"f^use_of a criterion refer-, 
enced testing program. ( 

This study represents the first attempt in Saginaw to look at sustained 
effects of both Chapt/er I participants and former participants. Based on 
this experience, a it is apparent that a number independent variables need to 
be controlled in x any subsequent studies. These variables include the follow- 
ing: variations among Chapter I program sites; history of students; partici- 
pation in other compensatory education. programs ; better identification of 

• - L ' 



*The "majority of t,he off-level testing was one level below the on-level 
testing. The norms supplied by the tes't publisher die) accommodate as much as 
two levels off in the nbrming process. However, the federal regulations "as 
interpreted by, the Michigan Department of Education advised a single l.qvel 
removed from on-level testing*. After the initial experience with functional 
level testing during the Fall of 1979, it was decided LhaL ail subsequent CAT 
testing would be on-level. , c ♦ 
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"false positives? 1 (those students whose scores exceeci the cut-off point for 
Chapter I eligibility while their actual functioning levels may be much 
lower); summer vacation effects; etc. Hopefully, this school district and 
others, with help from the Michigan State Department, of Education will do 
other studies to m&re definitively determine the~sustained effects of 
'Chapter 1 participation. x 

It was found that the academic achieve ment of Saginaw's compensatory 

— — ■ ■ ' 5* 

education population is associated positively with the amount of CQntinuous 



time spent^ in the Chapter I SIP program . When compensatory education ser- 
vices are interrupted, these students lose academically in both subject * 
areas either due to not having a chance to further consolidate learnings or 



fre~cause Efre measurement ot their achievement showed incorrectly .high levels 

of attainment. The interrupted group, however, showad a* smaller drop in * 
reading than in mathematics possibly due to the fact that reading skills 
?.re more likely to beidealt with~on - ~agular basis outside the school 
environment. Consequently, incidental learning of reading related skills 
is more likely to take place. 

A great deal of infotmation has been shared with the reader thus far.* 
X^this point an effort will be made to summarize this information and 




formulate concluding statements. 



SUMMARY AND CONCLUSIONS 

A study of the long-term 'sustained impact of the Chapter I Supplemental 
r • ' v * 
Teacher, Participation (STP) program on third grade participants during the 

t * v 

1979-80 school yea* was undertaken. A total of 256 students from an original 

group of 335 third grade STP participants who were pre- and post-tested dur- , 

ing? the 1979-80 school year were classified into oneoof four categories, of 

participation.* The participation categories were the following: one year, 

two year continuous, three year continuous, and two year interrupted. 

Two different standards wer^ used to gauge observed* growth of groups in 

each category. The firs.t growth equal to or exceeding norma T growth or, in 



~o trhe-r— words^— stret^rirrtiTt g * i io r m ^l"^affCtr"l^wl & oV exceeding chem. All tour 
category groups exceeded the standard of "normal growth 1 * in both academic 
areas except for the two year "interrupted group in mathematics. 

The second standard required growth equaling or exceeding the growth- of 
the three year continuous STP group. The three other groups failed this 
standard in both subjects with the exception of the two year continuous group 
, in mathematics. t . . \ 

A number of conclusions come from a review of the results. 

1. Of the 117* pupils who tested out at different test- 
ing points, a total of 87.2% (102 of 117) sustained 

•the ef/fects of the STP program's impact: \ 

* 20.5% fot* at least one yea^ (21 of 102) ^ • 

# /79.5%*for at least two \y eats (81of 102) 

2. For the pupils who had to stay in # Saginaw's Chapter I 
, t program for three years (54. 2%: 13*9 of 256), their 

test result's evidenced percentage gains in excess of 
"normhl growth 11 over the* three year period (23.37. and 4 
10.7% in reading and mathematics respectively). 
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3. Saginaw. 1 s Chapter 1 program shows larger gains' for three 
year continuous participation than 'for one or two year 
continuous or two year interrupted participation. 

• ? 

4, Saginaw' 1 s compensatory education program evidenced: 

if 

• The largest magnitude of NCE total net gain in mathe- 
matics . 

• The greatest increase over and above "normal growth' 1 
\n reading. ' 



A3 
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RECOMMENDATIONS 



Listed below are a series of recommendations based on the findings o^ 
this, study. These recommendations^ are offered in an effort- to improve the 
10frg-tenn LmpLementjilion and impact of the Chapter I STP program. 



J 



f. Definite plans for any future' sustained effects study 
should be outlined in advance to ensure that accurate 
longitudinal records of Chapter I participants are avail- 
able. .Such records would yieLd more comprehensive account- 
ing of all aspects of participation (.past history of parti- 
cipation, longitudinal test file linkage with unique 
student numbers for each student, determination of research/ 
evaluation questions of interest, necessary testing points 
to answer questions posed, etc-) nnri nl t- rniT*^n.Vy-.ffaV im- 



possible better understanding of the nature of any sustained 
effects through better controls; 

V 

2. Attention could be given to another set of grade levels 
to see if the. same trends also hold with other aged 

* participants. The inclusion of -ja ?i**h grade cohort 
in a three year longitudinal sfcu^yeems to be a work- 
able possibility because of adequate testing points to' 
^ make comparisons between par.ticipa-nts and non-partici- 
pants. * ^ 

3. Special study of. higher scoring STP participants vho* 
test-out but fetill seem»in need of compensatory educa- 
tion services *in subsequent years should be planned f6r 
and undertaken. Such a study would focus on' the follow- 
ing Questions. 

• Are there higher .achievers (relatively speaking) 

* really showing high scores because of a large error 
component to their test scores due to some testing 
related factor (e*g., guessing, improper test 1 
administration,' etc.)? 

♦ 

• Do these higher achieving students seem to possess 
any readily observable characteristics that set , 
them apart as a grou^? £ % 

• Do these students appear more frequently in certain 
buildings rather than others? 
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How much and what type of additional help should this 
group of ftflpils be given (if thd} can be identified) 
to foster lasting achievements? 

Can an 0 alternate cut-off criterion score be estab- 
lished to ensure fewer false positives? ^ 
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